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WHITEBOARD IMAGING SYSTEM 

BACKGROUND OF THE INVENTION 
The present invention relates to devices for 
obtaining information from a whiteboard or other 
5 writing surface. More particularly, the present 
invention relates to a system for obtaining visual 
images of the writing surface. 

Whiteboards are used commonly in schools, 
businesses or other gathering locations. Typically, the 
10 whiteboard includes a smooth planar surface that is 
mountable, for example, to a wall or other structure. 
Pens, typically of different colors, allow one or more 
individuals to draw on the whiteboard to explain ideas, 
concepts and the like. 
15 Various systems have been advanced in order 

to capture and record information written on a 
whiteboard. For instance, a whiteboard has been 
designed to include a pressure- sensitive array that 
senses contact and movement of the pen on the surface. 

2 0 In another embodiment, an ultrasonic sensor is mounted 

to the whiteboard. The sensor receives ultrasonic 
signals from transmitters provided on pens or erasers. 
The sensor triangulates a position of the pen or eraser 
on the board as the user writes or erases information. 
25 Although the prior art systems have enjoyed 

some success, widespread adoption of any one technology 
has not yet been achieved. Significant impediments 
include the current use of inexpensive whiteboards 
already installed in many locations. To use some of the 

3 0 systems advanced, these inexpensive whiteboards would 

have to be discarded and more expensive systems would 
have to be bought and installed. Although some 
technologies use current whiteboards, such as the 
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ultrasonic system described above, users must now use 
special pens, erasers and techniques in order to 
capture the information. 

There thus is a continuing need for a system 
5 to capture information on a whiteboard. Such a system 
would preferably use existing whiteboards, but would 
not require special pens, erasers, or other techniques 
that the operator must use or adapt to in order to 
capture information on the whiteboard. 

10 SUMMARY OF THE INVENTION 

An image capturing system is installable in 
a room opposite a writing surface. The image capturing 
system is adapted to take visual images of the writing 
surface and identify information written thereon. 

15 A second broad aspect includes an image 

capturing system having a visual sensor providing image 
data corresponding to sensed images. The visual sensor 
is selectively directed toward a first position to 
sense a first image and toward a second position to 

20 sense a second image. An image processor is coupled to 
the visual sensor to receive the image data from the 
visual sensor. The image processor is capable of 
processing the image data as a function of direction of 
the visual sensor toward the first position or the 

25 second position. 

A third broad aspect includes an image 
capturing system having a visual sensor providing image 
data corresponding to sensed visual images. The visual 
sensor includes a set of adjacent sensing elements 

3 0 being exposed collectively to successive portions of 
the image. In other words, the same sensing elements 
will be used more than once, to sense different 
portions, during capture of a single image. A storage 
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device stores sensing element control values. A 
controller is coupled to the storage device and the 
visual sensor. The controller controls a time duration 
of exposure of the sensing elements to the portion of 
5 image as a function of exposure to successive portions. 

A fourth aspect includes a method of 
obtaining information provided on a writing surface in 
a room. The method includes locating an image 
capturing system at a second location in the room 
10 remote from the writing surface; sensing a visual image 
of the writing surface with the image capturing system; 
and identifying information provided on the writing 
surface with the image capturing system. 

BRIEF DESCRIPTION OF THE DRAWINGS 
15 FIG. 1 is a perspective view of a room with 

portions removed illustrating exemplary locations for a 
visual sensor. 

FIG. 2 is a schematic block diagram of an 
image capturing system. 
20 FIG. 3 is a schematic block diagram of the 

visual sensor. 

FIG. 4 is a functional block diagram of a 
first embodiment of the visual sensor. 

FIG. 5 is a functional block diagram of a 
2 5 second embodiment of the visual sensor. 

FIG. 6 is a functional block diagram of a 
third embodiment of the visual sensor. 

FIG. 7 is a flow chart illustrating setup of 
the image capturing system. 
30 FIG. 8 is an elevation view of a writing 

surface . 

FIG. 9 is an elevation view of the writing 

surface . 



FIG. 10 is a top plan view of a user- 
operated switch. 

DETAILED DESCRIPTION OF THE ILLUSTRATIVE EMBODIMENTS 
Referring to FIG. 1, a first broad aspect of 
5 the present invention includes an image capturing 
system 10 disposed in a room 11 having a defined 
writing surface 14A, such as a whiteboard. In the 
embodiment illustrated, the image capturing system 10 
includes a visual sensor 13 that visually senses images 

10 provided on the writing surface 14A. An image processor 
2 0 , such as a desktop computer , receives image data 
from the visual sensor 13 and is adapted to identify 
information provided on the writing surface 14A. 

Generally, the visual sensor 13 is disposed 

15 in a fixed location in the room 11 so as to obtain 
substantially identical, successive images of the 
writing surface 14A. In FIG. 1, two exemplary positions 
are illustrated. In a first position, visual sensor 13 
is mounted to a wall 12, or some other like fixed 

20 structure, that is generally opposite the writing 
surface 14A so as to face the writing surface 14A. In a 
second position, visual sensor 13 is disposed on a 
ceiling 17, or other suspended structure, in order to 
view the writing surface 14A from above. The second 

25 position is also convenient for obtaining visual images 
of other writing surfaces, such as writing surface 14B. 
In yet a further embodiment, the visual sensor 13 can 
be directed to also obtain visual images of other areas 
in the room 11, for example, a predefined surface area 

3 0 15 of a table or desk 16 located below the visual 
sensor 13. It should be noted that the ceiling location 
of visual sensor 13 is not the only location in the 
room 11 in order to view multiple writing surfaces or 
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predefined areas. For instance, depending upon the 
location of the writing surfaces 14A and 14B in the 
room 11, visual sensor 13 could be located in a corner 
or other fixed position in order to selectively view 
5 the writing surfaces 14A and 14B . 

FIG. 2 and the related discussion are 
intended to provide a brief, general description of a 
suitable computing environment in which the image 
processing system 10 may be implemented. Although not 

10 required, the image processing system 10 will be 
described, at least in part, in the general context of 
computer- executable instructions, such as program 
modules being executed by a controller, a personal 
computer or other computing device. Generally, program 

15 modules include routine programs, objects, components, 
data structures, etc., that perform particular tasks or 
implement particular abstract data types. Those skilled 
in the art can implement the description, block 
diagrams and flow charts to computer-executable 

20 instructions. In addition, those skilled in the art 
will appreciate that the invention may be practiced 
with other computer system configurations, including 
hand-held devices, multiprocessor systems, 

microprocessor-based or programmable consumer 

25 electronics, network PCs, minicomputers, mainframe 
computers, and the like. The invention is also 
applicable in distributed computing environments where 
tasks are performed by remote processing devices that 
are linked through a communications network. In a 

3 0 distributed computing environment, program modules may 
be located in both local and remote memory storage 
devices . 

With reference to FIG. 2, an exemplary environment 



for the image processor includes a general purpose 
computing device in the form of a conventional personal 
computer 20, including processing unit 21, a system 
memory 22, and a system bus 23 that couples various 
5 system components including the system memory to the 
processing unit 21. The system bus 23 may be any of 
several types of bus structures including a memory bus 
or memory controller, a peripheral bus, and a local bus 
using any of a variety of bus architectures. The system 

10 memory includes read only memory (ROM) 24 and random 
access memory (RAM) 25. A basic input/output system 26 
(BIOS) , containing the basic routine that helps to 
transfer information between elements within the 
personal computer 20, such as during start-up, is 

15 stored in ROM 24. The personal computer 2 0 further 
includes a hard disk drive 27 for reading from and 
writing to a hard disk (not shown) , a magnetic disk 
drive 2 8 for reading from or writing to removable 
magnetic disk 29, and an optical disk drive 30 for 

2 0 reading from or writing to a removable optical disk 31 

such as a CD ROM or other optical media. The hard disk 
drive 27, magnetic disk drive 28, and optical disk 
drive 3 0 are connected to the system bus 23 by a hard 
disk drive interface 32, magnetic disk drive interface 
25 33, and an optical drive interface 34, respectively. 
The drives and the associated computer- readable media 
provide nonvolatile storage of computer readable 
instructions, data structures, program modules and 
other data for the personal computer 20, 

3 0 Although the exemplary environment described 

herein employs a hard disk, a removable magnetic disk 
29 and a removable optical disk 31, it should be 
appreciated by those skilled in the art that other 



types of computer readable media which can store data 
that is accessible by a computer, such as magnetic 
cassettes, flash memory cards, digital video disks, 
Bernoulli cartridges, random access memories (RAMs) , 
5 read only memory (ROM) , and the like, may also be used 
in the exemplary operating environment. 

A number of program modules may be stored on the 
hard disk, magnetic disk 29, optical disk 31, ROM 24 or 
RAM 25, including an operating system 35, one or more 

10 application programs 36, other program modules 37, and 
program data 38. A user may enter commands and 
information into the personal computer 20 through input 
devices such as a keyboard 4 0 and pointing device 
(mouse) 42. Other input devices (not shown) may include 

15 a microphone, joystick, game pad, satellite dish, 
scanner, or the like. These and other input devices, 
including the visual sensor 13, are often connected to 
the processing unit 21 through a serial port interface 
46 that is coupled to the system bus 23, but may be 

2 0 connected by other interfaces, such as a sound card, a 
parallel port, a game port or a universal serial bus 
(USB) . A monitor 47 or other type of display device is 
also connected to the system bus 23 via an interface, 
such as a video adapter 48. In addition to the monitor 

25 47, personal computers may typically include other 
peripheral output devices such as a speaker and 
printers (not shown) . 

The personal computer 2 0 may operate in a 
networked environment using logic connections to one or 

30 more remote computers, such as a remote computer 49. 
The remote computer 4 9 may be another personal 
computer, a server, a router, a network PC, a peer 
device or other network node, and typically includes 
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many or all of the elements described above relative to 
the personal computer 20, although only a memory 
storage device 50 has been illustrated in FIG, 2. The 
logic connections depicted in FIG. 2 include a local 
5 are network (LAN) 51 and a wide area network (WAN) 52. 
Such networking environments are commonplace in 
offices, enterprise-wide computer network intranets and 
the Internet. 

When used in a LAN networking environment, the 

10 personal computer 2 0 is connected to the local area 
network 51 through a network interface or adapter 53. 
When used in a WAN networking environment, the 
personal computer 2 0 typically includes a modem 54 or 
other means for establishing communications over the 

15 wide area network 52, such as the Internet. The modem 
54, which may be internal or external, is connected 
to the system bus 23 via the serial port interface 
46. In a network environment, program modules 
depicted relative to the personal computer 20, or 

2 0 portions thereof, may be stored in the remote memory 

storage devices. It will be appreciated that the 
network connections shown are exemplary and other 
means of establishing a communications link between 
the computers may be used. 
25 Although described above wherein a desktop 

computer 2 0 will process image data from the visual 
sensor 13, it should be noted that the visual sensor 
13 could also include some of the components used for 
processing and storage. For instance, the visual 

3 0 sensor 13 could include a processor for processing 

the image data for storage on a mass storage device 
such as a hard disk or floppy disk. If stored on a 
floppy disk, the image data can then be removed and 
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transferred to another computer. Likewise, a wired or 
wireless communications interface can be included to 
transfer data from the visual sensor 13 to other 
computing devices. 
5 FIG. 3 is a block diagram of an exemplary form 

of the visual sensor 13 . Generally, the visual sensor 
13 includes a visual sensing device 60 operably 
coupled to a controller 64. As appreciated by those 
skilled in the art, the visual sensing device 60 can 

10 take many forms, for instance, sensing devices 

commonly used in digital cameras, video cameras, 
scanners, fax machines, or digital copiers can be 
used. Referring to the embodiment illustrated in FIG. 
4, the visual sensing device 60 comprises a linear 

15 array of sensing elements (e.g. charge coupled 

devices "CCD") such as commonly found in scanners. In 
order to obtain a complete visual image of the 
writing surface 14A, the linear array 60 scans the 
writing surface 14A and receives successive portions 

20 of the writing surface 14A. As is well known, an 

output signal from the linear array 60 is related to 
each successive portion of the writing surface 14A. 
The output signals are provided to controller 64. 
Controller 64 operates the linear array 60, As used 

25 herein, the controller 64 can include components such 
as a processor, memory and software for operation and 
an interface for communication with the computer 20. 
If desired, the controller 64 can process or operate 
upon the data received from the linear array 6 0 in 

3 0 order to provide compression or encoding, as is known 
in the art. Generally, the linear array 60 and the 
controller 64 can be of the type commonly found in 
scanners, fax machines, digital copiers and the like. 
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Various means can be used to provide successive 
visual portions of the writing surface 14A to the 
linear array 60. As illustrated in FIG. 4, a panning 
motor 66 is coupled to a housing 68 or other 
5 structure used to support a lens 70 and the linear 

array 60. The panning motor 64 rotates the housing 68 
in order to scan the writing surface 14A. For 
uniformity and simplicity, the angular velocity can 
be a constant. However, the velocity can also be 

10 varied. In another embodiment as illustrated in FIG. 
5, the linear array 60 is displaced linearly within 
the housing 68 by a motor 69 similar to a scanner. In 
this embodiment, the housing 68 and the lens 70 
remain substantially fixed. In yet another embodiment 

15 as illustrated in FIG. 6, a motor 73 rotates a mirror 
74 to reflect successive portions of the writing 
surface 14A to the linear array 60. These techniques 
can be used by themselves or in combination to direct 
the visual sensor 13 to one or more writing surfaces 

20 14A, 14B and surface 15. 

The image data from the sensing device 60 can be 
temporarily stored by the controller 64 and then 
transferred to the image processor 20. Alternatively, 
the image data can be transferred immediately to the 

25 image processor 20, where it must be stored as it 
arrives . 

FIG. 7 illustrates a method 80 of installation 
of the image capturing system 10. Step 82 includes 
installing the visual sensor 13 at a fixed location 
30 to obtain visual images of the desired writing 

surface 14A. Typically, optical distortion may exist 
in the visual image sensed by the visual sensor 13, 
depending upon the relative location of the visual 
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sensor 13 with respect to the writing surface 14A, 
One common form of optical distortion includes 
"keystoning" where a rectangular writing surface 14A 
may result in a trapezoidal or other non-rectangular 
5 visual image. Other forms of optical distortion 

include lens distortions; distortions generated by 
the scanning setup in FIG. 4 where the distance to 
particular image portions, and hence their size on 
the image sensor, vary across the writing surface; 

10 ghost images (due to misalignment of R,G and B 

sensors: can be fixed by detection with convolution 
followed by subtraction of ghosts) ; blurring (due to 
lack of resolution of sensors-can be partially 
corrected by multiple scans, also called hyper- 

15 resolution) ; and sensor saturation (cannot be fixed, 
but can be avoided by calibration, or multiple scan 
at various sensitivity levels) . 

Step 84 comprises measuring any optical 
distortion and providing processing values therefore 

20 for each writing surface 14A, 14B or predefined 
surface 15. The processing values can be stored 
either in the controller 64 in a storage device such 
as memory, or in the image processor 2 0 in any of the 
storage devices described above. Referring to FIG. 8, 

25 step 84 can include placing markers 88A, 88B, 88C and 
88D or other identifiers on each writing surface 14A, 
14B or predefined surface 15 in a pattern. For 
example, the markers 88A-88D can be used disposed at 
the corners of a rectangle. (Note, for distortions 

3 0 other than keystoning, like lens and scanning 

distortions, four or more markers, for example, nine 
equally spaced markers may be needed to obtain 
corrections.) The visual sensor 13 is then operated 
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to obtain a visual image of the writing surface 14A 
or predefined surface 15 with the markers 88A-88D, In 
one embodiment, the visual image obtained for the 
visual sensor 13 can be displayed upon the monitor 
5 47. The user can then identify each of the markers 
88A-88D as input into a program or other routine to 
calculate the optical distortion and obtain a 
processing value or values, which would correct the 
visual image to yield a true representation of the 

10 writing surface 14A or predefined surface 15. As used 
herein, a "processing value" includes any corrective 
technique, function or quantity, and therefore should 
not be construed narrowly. In yet another embodiment, 
the program or routine can automatically identify the 

15 markers 88A-88D and calculate the necessary 

correction value to perform the required optical 
corrections . 

At this point, it should be noted that the lens 
70 of the visual sensor 13 can include a zoom lens in 

2 0 order to magnify the visual image of the writing 

surface 14A or predefined surface 15 to efficiently 
use all available resolution provided by the sensing 
device 60, such as the linear array. If the visual 
sensor 13 is used to provide visual images of two or 
25 more different areas (e.g. writing surfaces 14A and 

14B and/or predefined surface area 15) , the zoom lens 
can be motor-actuated wherein a processing value is 
stored by the controller 64 indicative of the proper 
setting for each writing surface 14A, 14B or area 15 

3 0 to be viewed. In another embodiment, a plurality of 

fixed focal length lenses can be selectively placed 
{manually or automatically) in the optical path of 
the visual sensor 13 in order to provide some optical 
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magnif ication wherein software routines can be 
provided to perform additional magnification. Of 
course, software magnification can also be provided 
with the zoom lens, 
5 Step 90 represents an optional step of obtaining 

reference visual images of the writing surface 14A 
under different lighting conditions. In particular, 
in view that the writing surface 14A, 14B or 
predefined surface area 15 may have different levels 

10 of an incident light from lights within the room or 
from outside conditions through windows, it may be 
helpful to obtain one or more reference visual 
images. For instance, one reference visual image can 
be obtained on a bright sunny day with the window 

15 shades open and with all the lights in the room on. 
Another reference visual image may be obtained for 
the same conditions except with the window shades 
closed. Likewise, reference visual images can be 
obtained on cloudy days, at night and at various 

20 levels of room lighting » Reference visual images can 
also be obtained at different times during the day if 
incident light upon the writing surface or other 
surface to be scanned changes throughout the day. 

The reference visual image or images obtained at 

25 step 90 can be used in order to extract information 
provided on the writing surface 14A. For instance, 
when a visual image is obtained of the writing 
surface 14 A having information present thereon, one 
of the reference visual images can be compared with 

3 0 the current image in order to extract the 

information. In many cases, the writing surface 14A 
only contains a limited amount of text, numbers, 
shapes or other information whereas a majority of the 
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writing surface 14A is not used and therefore remains 
its unchanged or background color. By comparing the 
current visual image with a reference visual image of 
the writing surface 14A where no information is 
5 present, the information (i.e. the foreground) of the 
current visual image can be easily obtained. In one 
exemplary embodiment for a whiteboard having a white 
surface, information written on the writing surface 
will correspond to less light intensity sensed by the 

10 sensing elements of the linear array 60 than that of 
the background. Corresponding values can be 
associated for different levels of light intensity. A 
comparison then can be performed by subtracting the 
value of a sampled portion of the current visual 

15 image (e.g. the value of one sensing element of 

linear array 60 for one linear portion of the visual 
image) from the corresponding value of the sampled 
portion of the reference visual image. If the 
resulting value exceeds a threshold, information can 

2 0 be considered present for the sampled portion of the 

current visual image. In this manner, the current 
visual image is compared to the reference visual 
image element by element to obtain the information on 
the writing surface 14A, Depending on the lighting 
25 conditions or the time of day, the closest reference 
visual image can be used in order to minimize effects 
of bright areas, glares, shadows, etc. 

At this point it should be noted that 
compression gan be provided for distribution of the 

3 0 images. As appreciated as those in the art, writing 

surfaces such as whiteboards are mostly white, and 
the information written thereon is mostly lines of 
uniform colors. A good compression algorithm for 
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this type of image could be to separate the image 
into a foreground (the ink) and a background (the 
white) with a binary image, called a mask, which 
tells if a pixel belongs to the foreground (1) or the 
5 background (0) . Algorithms for computing the mask can 
be as simple as a fixed threshold on the luminance 
(above the threshold is foreground and below is 
background) or more complex, such as the algorithms 

used in DjVu™, for example, as described in "High 

10 Quality Document Image Compression with DjVu", 

Journal of Electronic Imaging, 1998 and "Browsing 
Through High Quality Document Images with DjVu", In 
Proc , of Advances in Digital Libraries 98. IEEE, 
1998, which are hereby incorporated by reference in 

15 their entirety. The binary image can be compressed 
using standard FAX compression. Because the mask is 
binary and is typically made out of smooth lines, the 
mask has an ideal distribution for an arithmetic 
encoder, such as used in FAX compression. The 

2 0 foreground and the background are smooth color images 
with don't care conditions on the masked part. The 
binary image can be compressed with "masked wavelets" 
(i.e. a wavelet representation which agrees with the 
image on the "do care" pixels, and have values on the 

25 "don't care" pixel in order to maximize compression). 
For instance, the background can be set to white on 
its "don't care" pixel, resulting in a mostly white 
image with smoothly varying shades depending on the 
lighting. Such an image compresses very well with 

30 wavelets. Similarly, the foreground has mostly "don't 
care" pixels, which can be set to the color of the 
pen in the region surrounding ink, leading to images 
which are mostly uniform in large regions. 
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The reference visual images can also be used to 
calibrate the sensing device 60 for various lighting 
conditions. In particular, processing values such as 
gain adjustments or sampling speeds (time duration of 
5 exposure of the sensing element) of the sensing 

device 60 can be calculated for each reference visual 
image and stored for later use with each visual image 
having information to obtain. The appropriate stored 
gain adjustments or sampling speeds can then be 

10 retrieved based on the surface 14A, 14B or 15 being 
imaged, the current lighting conditions, and/or the 
time of day, and applied to the current visual image 
to improve performance . 

In the embodiment illustrated in FIGS. 4-6, the 

15 sensing device 6 0 comprises a linear array of sensing 
elements that is exposed to portions of the writing 
surface 14A, 14B and surface 15 successively. The 
gain adjustments or sampling speeds of the sensing 
elements can be stored as control values in a storage 

20 device accessible by the controller 64. The 

controller 64 can make gain adjustments and sampling 
speed adjustments to all the sensing elements as a 
group for each image portion of visual image. 
Alternatively, gain adjustments and sampling speed 

25 adjustments of the sensing elements can be made in 
smaller groups of the sensing elements in the array 
for each image portion, or even individually for each 
image portions. 

In another mode of operation, the reference 

3 0 visual image is obtained before each visual image 
that is used to record information on the writing 
surfaces 14A, 14B or the predefined surface area 15. 
In this manner, the gain adjustments and/or sampling 
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speeds can be calculated and adjusted based on the 
current lighting conditions. If desired, the 
reference visual image could be taken more quickly 
(i.e. lower resolution) than a normal visual image. 
5 Also, the reference visual image can be considered 

valid for a selected time period, wherein if a visual 
image is desired after the time period has elapsed, a 
new reference visual image can be obtained. As 
appreciated by those skilled in the art, the 

10 reference visual images discussed herein can include 
some written information on the writing surface and 
need not be completely devoid of any markings, etc. 
The gain adjustments and/or sampling speeds can be 
calculated as the mean or other statistical function 

15 of response of the sensing device 6 0 to provide the 
reference visual image . 

The gain adjustments and/or sampling speeds can 
also be calculated based on samples taken from a 
plurality of locations 94A, 94B, 94C, 94D, 94E, 94F, 

20 94G, 94H, 941 and 94J (herein exemplified as ten 
locations) on the writing surface 14A, 14B or 
predefined surface 15 such as illustrated in FIG. 9. 
The gain adjustments and/or sampling speeds for other 
locations on the writing surface 14A, 14B and 

25 predefined surface area 15 can then be interpolated 
and/or extrapolated based on the plurality of 
locations 94A-94J. If any of the plurality of 
locations 94A-94J is suspected to include information 
(foreground material) , the location can be omitted. 

3 0 Another possibility is to identify the foreground 
colors in a color histograms (the foreground colors 
will appear as sharp peaks) . The pixels identified 
as foreground can then be replaced by the surrounding 
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background color to yield a '"cleaned" reference 
background image. In this manner, previous visual 
images could be used as a reference visual image for 
calculation of gain adjustments and/or sampling 
5 speeds for a later visual image. 

It should also be noted that a visual image of 
the writing surface 14A, 14B or predefined surface 
area 15 need not be obtained from only one scan or 
image thereof. In other words, the visual image of 

10 the writing surface 14A, 14B or predefined surface 

area 15 can be formed from a composite of a plurality 
of separate scans or images. As illustrated in FIG. 
9, the writing surfaces 14A, 14B or predefined 
surface area 15 may include areas of bright intensity 

15 95, for example, from lights or windows, or areas 

having shadows 97. From the reference visual image or 
the current visual image, these areas can be 
identified from the response of the sensing device 
60, for example, when light intensity exceeds or 

20 falls below selected thresholds. The gain adjustment 
and/or sampling speed can then be adjusted to 
compensate for one of the identified areas, and the 
writing surface 14A, 14B or predefined surface area 
15, or portion thereof, can be rescanned or reimaged 

25 and stored. Additional visual images can be obtained 
with appropriate compensation provided for each 
identified area. Since each visual image is taken 
from the same fixed position, and since the writing 
surfaces 14A, 14B and predefined surface area 15 are 

3 0 also fixed, multiple visual images can be easily 
combined to form a composite with greater clarity 
than any one scan or image. 

The image capturing system 10 can be initiated 
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manually, at the visual sensor 13, at the image 
processor 20, and/or with a remote, possibly, 
handheld switch. FIG. 10 is an exemplary top plan 
view of a remote handheld switch 110. A first button 
5 112 can be used to indicate to the visual sensor 13 
that a visual image of writing surface 14A should be 
obtained, while a second button 114 can be used to 
indicate that the visual sensor 13, or a portion 
thereof such as mirror, should be directed at the 
10 second writing surface 14B or predefined surface area 
15 to obtain a corresponding visual image. Of course, 
additional buttons can be provided for other imaging 
areas . 

If desired, the visual sensor 13 can be operated 

15 so as to obtain periodic visual images of the writing 
surface 14A. An indicator 116 (FIG. 1) such as a 
light or a speaker on the visual sensor 13, the image 
processor 20 or the switch 110 can be used to 
indicate to users in the room 11 that the visual 

20 sensor 13 is going to obtain a visual image shortly, 
or that the visual sensor 13 is obtaining a visual 
image. If periodic visual images are obtained, a 
software routine can be provided to compare the 
current visual image with one or more prior images 

25 and keep only those that have changed. For instance, 
the subtraction technique described above can be used 
wherein suitable thresholds are provided to detect 
new information including erasures. 

In summary, the image capturing system 10 

3 0 enables information to be easily obtained from a 
writing surface or predefined surface area. The 
information can be stored in any suitable format for 
transfer to other computers or applications. If 
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desired, optical character recognition can be 
performed on the textual portions of the information 
Likewise, other portions of the information having 
simple drawings can be converted into known drawing 
5 formats. 

Although the present invention has been 
described with reference to preferred embodiments, 
workers skilled in the art will recognize that 
changes may be made in form and detail without 
10 departing from the spirit and scope of the invention 
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WHAT IS CLAIMED IS: 

1. An image capturing system comprising: 

a visual sensor providing image data corresponding 
to sensed images, the visual sensor 
selectively directed toward a first position 
to sense a first image and toward a second 
position to sense a second image; and 

an image processor coupled to the visual sensor to 
receive the image data from the visual 
sensor, the image processor capable of 
processing the image data as a function of 
direction of the visual sensor toward the 
first position or the second position. 

2 . The image capturing system of claim 1 and further 
comprising 

a storage device for storing a first processing 
value and a second processing value, wherein 
the image processor processes the image data 
of the first position using the first 
processing value, and wherein the image 
processor processes the image data of the 
second position using the second processing 
value . 

3. The image capturing system of claim 2 wherein the 
visual sensor includes a zoom lens, and wherein the 
first processing value relates to a first setting of 
the zoom lens and the second processing value relates 
to a second setting of the zoom lens. 

4 . The image capturing system of claim 2 wherein the 
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first processing value relates to an optical correction 
for distortion of the first image and the second 
processing value relates to an optical correction for 
distortion of the second image, 

5 , The image capturing system of claim 1 wherein the 
visual sensor comprises a sensing device having a 
plurality of sensing elements. 

6 , The image capturing system of claim 5 wherein the 
sensing device comprises a linear array of sensing 
elements , 

7, An image capturing system comprising: 

a visual sensor adapted to provide image data 
corresponding to sensed visual images of a 
writing surface; and 

an image processor coupled to the visual sensor to 
receive the image data from the visual 
sensor, the image processor capable of 
identifying information provided on the 
writing surface apart from the writing 
surface . 

8 , The image capturing system of claim 7 and further 
comprising a storage device for storing a reference 
visual image, and wherein the image processor is 
coupled to the storage device to access the reference 
visual image to identify information provided on the 
writing surface, 

9, The image capturing system of claim 7 wherein the 
visual sensor comprises a sensing device adapted to 
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scan the writing surface. 

10. The image capturing system of claim 7 and further 
comprising a storage device for storing a processing 
value related to correction of the visual image for 
optical distortion, wherein the image processor is 
coupled to the storage device to access and use the 
processing value during im.age processing. 

11. The image capturing system of claim 7 wherein the 
image processor is adapted to identify an area 
requiring reimaging. 

12. The image capturing system of claim 11 wherein the 
image processor controls the visual sensor to obtain a 
second visual image of at least the area, if reimaging 
is required, and wherein the processor is adapted to 
combine the first -mentioned visual image with the 
second visual image. 

13. An image capturing system comprising: 

a visual sensor providing image data corresponding 
to sensed images, the visual sensor 
comprising a set of adjacent sensing 
elements being exposed collectively to 
successive portions of the image; and 

a storage device for storing sensing element 
control values 

a controller coupled to the storage device and the 
visual sensor, the controller controlling a 
time duration of exposure of the sensing 
elements to the portion of image as a 
function of exposure to successive portions. 
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14 . The image capturing system of claim 13 wherein a 
sensing element control value is provided for each 
sensing element for each successive portion of the 
image . 

15. The image capturing system of claim 13 and further 
comprising: an image processor coupled to the visual 
sensor to receive the image data from the visual 
sensor, the image processor capable of identifying 
information provided on the writing surface apart from 
the writing surface. 

16. The image capturing system of claim 15 and further 
comprising a storage device for storing a reference 
visual image, and wherein the image processor is 
coupled to the storage device to access the reference 
visual image to identify information provided on the 
writing surface. 

17. The image capturing system of claim 15 and further 
comprising a storage device for storing a processing 
value related to correction of the visual image for 
optical distortion, wherein the image processor is 
coupled to the storage device to access and use the 
processing value during image processing. 

18. In combination with a defined writing surface 
provided in a fixed location in a room, an image 
capturing system disposed in the room at a second 
location remote from the writing surface to sense 
successive visual images of the writing surface and 
adapted to identify information provided on the writing 
surface . 
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19. The combination of claim 18 wherein the image 
capturing system including an image processor to 
identify information on the writing surface as a 
function of a reference visual image of the writing 
surface . 

20. The combination of claim 18 wherein the image 
capturing system includes a visual sensor disposed 
above the writing surface. 

21. The combination of claim 20 wherein the visual 
sensor is mounted to a ceiling of the room. 

22. The combination of claim 18 wherein the image 
capturing system includes a visual sensor disposed 
within the room to sense images of the writing surface 
and a second area spaced apart from the writing 
surface . 

23. The combination of claim 22 wherein the visual 
sensor is mounted to a wall of the room. 

24. The combination of claim 23 wherein the visual 
sensor is disposed above the writing surface. 

25. The combination of claim 24 wherein the visual 
sensor is mounted to a ceiling of the room. 

26. The combination of claim 18 wherein the image 
capturing system includes a visual sensor adapted to 
scan the writing surface. 
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27. A method of obtaining information provided on a 
writing surface in a room, the method including: 

locating an image capturing system at a second 
location in the room remote from the writing 
surface; 

sensing a visual image of the writing surface with 

the image capturing system; and 
identifying information provided on the writing 

surface with the image capturing system. 

28. The method of claim 27 wherein identifying 
information includes identifying information as a 
function of a reference visual image of the writing 
surface . 

29. The method of claim 27 wherein sensing a viaial 
image includes compensating for distortion of the 
visual image . 

30. The method of claim 27 wherein sensing includes 
sensing a plurality of visual images. 

31. The method of claim 3 0 wherein identifying 
includes identifying information as a function of a 
plurality of visual images. 

32. The method of claim 31 wherein identifying 
includes identifying includes comparing a first visual 
image to a second visual image. 

33. The method of claim 31 wherein sensing a visual 
image includes imitating sensing of a visual image with 
a switch movable relative to the second location. 
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34. The method of claim 31 wherein the image capturing 
system is selectively directable to obtain a visual 
image of the writing surface and a visual image of a 
second area, the method further comprising directing 
the image capture system toward the writing surface or 
the second area, and wherein sensing includes sensing a 
visual image of the writing surface or the second area. 

35. The method of claim 34 wherein positioning 
includes operating a switch to direct the image capture 
system toward the writing surface or the second area. 

36. The method of claim 34 wherein sensing comprises 
providing image data corresponding to the visual image, 
and wherein the method further comprises storing a 
first processing value and a second processing value, 
and processing the image data using the first 
processing value and the second processing value as a 
function of direction of the image capture system 
toward the writing surface or the second area, 
respectively. 

37. The method of claim 31 wherein sensing comprises 
scanning the writing surface. 

38. The method of claim 31 wherein identifying 
information includes detecting an area of the writing 
surface requiring reimaging. 

39. The method of claim 3 8 and further comprising: 
reimaging at least the area of the writing surface 

to obtain a second visual image; and 
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combining the first -mentioned visual image with 
the second visual image. 
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WHITEBOARD SCANNING SYSTEM 

ABSTRACT OF THE DISCLOSURE 
An image capturing system is installable in a room 
opposite a writing surface. The image capturing system 
is adapted to take visual images of the writing surface 
and identify information written thereon. 
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SPECIFICATION AND INVENTORSHIP IDENTIFICATION 



As a below named inventor, I declare that: 

My residence, post office address and citizeiship are as stated below next to my 

name . 

I believe I am a joint inventor of the subject matter which is claimed, and for 
which a patent is sought, on the invention entitled WHITEBOARD IMAGING SYSTEM the 
specification of which, 

(check one) 

X is attached hereto. 

was filed on , as Appln. Serial No. . 

and was amended on . 

described and claimed in PCT International Application 

No. filed on and as amended under PCT Article 
19 on . 

ACKNOWLEDGEMENT OF REVIEW OF PAPERS AND DUTY OF CANDOR 

I have reviewed and understand the contents of the above identified 
specification, including the claims, as amended by any amendment referred to above, I 
acknowledge the duty to disclose information which is known to me to be material to the 
patentability of this application in accordance with Title 37, Code of Federal 
Regulations, § 1.56. 

PRIORITY CLAIM (35 USC § 119) 

I claim foreign priority benefits under Title 35, United States Code, §119 of 
any foreign application (s) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate 
having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application (s) 
Number Country Day/Month/Year Filed Priority Claimed 
Yes No 

PRIORITY CLAIM (35 USC § 120) 

I claim the benefit under Title 35, United States Code, §120 of any United 
States application (s) listed below. Insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the 
manner provided by the first paragraph of Title 35 United States Code §112, I 
acknowledge the duty to disclose to the Patent Office all information known to me to be 
material to patentability as defined in Title 3 7 Code of Federal Regulations §1.5G 
which became available between the filing date of the prior application and the national 
or PCT international filing date of this application: 
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DECLARATION 

I declare that all statements made herein that are of my own knowledge are true 
and that all statements that are made on information and belief are believed to be true; 
and further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 



POWER OF ATTORNEY 

I appoint the following attorneys and agents to prosecute the patent application 
identified above and to transact all business in the Patent and Trademark Office 
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Judson K. Champlin, Reg. No. 34,797; Joseph R. Kelly, Reg. No. 34,847; Nickolas E. 
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34,557; John D. Veldhuis-Kroeze, Reg. No. 38,354; Deirdre Megley Kvale, Reg. No. 35,612; 
Theodore M. Magee, Reg. No. 39,758; Peter S. Dardi , Reg. No. 39,650; Christopher R. 
Christenson, Reg. No. 42,413; John A. Wiberg, Reg. No. P-44,401; Katie E. Sako, Reg. No. 
32,628; and Daniel D. Grouse, Reg. No. 32,022. 

I ratify all prior actions taken by Westman, Champlin & Kelly, P. A. or the 
attorneys and agents mentioned above in connection with the prosecution of the above- 
mentioned patent application. 
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